New South Wales
- North America > Canada > Quebec > Montreal (0.14)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.14)
- North America > United States > Louisiana > Orleans Parish > New Orleans (0.04)
- (9 more...)
- Information Technology > Communications > Social Media (0.95)
- Information Technology > Data Science (0.89)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Uncertainty > Bayesian Inference (0.68)
- Information Technology > Artificial Intelligence > Machine Learning > Learning Graphical Models > Directed Networks > Bayesian Learning (0.46)
Stability and Generalization of Push-Sum Based Decentralized Optimization over Directed Graphs
Liang, Yifei, Sun, Yan, Cao, Xiaochun, Shen, Li
Push-Sum-based decentralized learning enables optimization over directed communication networks, where information exchange may be asymmetric. While convergence properties of such methods are well understood, their finite-iteration stability and generalization behavior remain unclear due to structural bias induced by column-stochastic mixing and asymmetric error propagation. In this work, we develop a unified uniform-stability framework for the Stochastic Gradient Push (SGP) algorithm that captures the effect of directed topology. A key technical ingredient is an imbalance-aware consistency bound for Push-Sum, which controls consensus deviation through two quantities: the stationary distribution imbalance parameter $δ$ and the spectral gap $(1-λ)$ governing mixing speed. This decomposition enables us to disentangle statistical effects from topology-induced bias. We establish finite-iteration stability and optimization guarantees for both convex objectives and non-convex objectives satisfying the Polyak--Łojasiewicz condition. For convex problems, SGP attains excess generalization error of order $\tilde{\mathcal{O}}\!\left(\frac{1}{\sqrt{mn}}+\fracγ{δ(1-λ)}+γ\right)$ under step-size schedules, and we characterize the corresponding optimal early stopping time that minimizes this bound. For PŁ objectives, we obtain convex-like optimization and generalization rates with dominant dependence proportional to $κ\!\left(1+\frac{1}{δ(1-λ)}\right)$, revealing a multiplicative coupling between problem conditioning and directed communication topology. Our analysis clarifies when Push-Sum correction is necessary compared with standard decentralized SGD and quantifies how imbalance and mixing jointly shape the best attainable learning performance.
- Asia > China > Guangdong Province > Shenzhen (0.04)
- Europe > Montenegro (0.04)
- Oceania > Australia > New South Wales > Sydney (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
Distillation and Interpretability of Ensemble Forecasts of ENSO Phase using Entropic Learning
Groom, Michael, Bassetti, Davide, Horenko, Illia, O'Kane, Terence J.
This paper introduces a distillation framework for an ensemble of entropy-optimal Sparse Probabilistic Approximation (eSPA) models, trained exclusively on satellite-era observational and reanalysis data to predict ENSO phase up to 24 months in advance. While eSPA ensembles yield state-of-the-art forecast skill, they are harder to interpret than individual eSPA models. We show how to compress the ensemble into a compact set of "distilled" models by aggregating the structure of only those ensemble members that make correct predictions. This process yields a single, diagnostically tractable model for each forecast lead time that preserves forecast performance while also enabling diagnostics that are impractical to implement on the full ensemble. An analysis of the regime persistence of the distilled model "superclusters", as well as cross-lead clustering consistency, shows that the discretised system accurately captures the spatiotemporal dynamics of ENSO. By considering the effective dimension of the feature importance vectors, the complexity of the input space required for correct ENSO phase prediction is shown to peak when forecasts must cross the boreal spring predictability barrier. Spatial importance maps derived from the feature importance vectors are introduced to identify where predictive information resides in each field and are shown to include known physical precursors at certain lead times. Case studies of key events are also presented, showing how fields reconstructed from distilled model centroids trace the evolution from extratropical and inter-basin precursors to the mature ENSO state. Overall, the distillation framework enables a rigorous investigation of long-range ENSO predictability that complements real-time data-driven operational forecasts.
- Indian Ocean (0.04)
- South America (0.04)
- Europe > Germany > Rhineland-Palatinate > Kaiserslautern (0.04)
- (7 more...)
- Africa > Central African Republic > Ombella-M'Poko > Bimbo (0.04)
- Oceania > Australia > New South Wales > Sydney (0.04)
- Asia > China > Guangdong Province > Guangzhou (0.04)
- Asia > China > Beijing > Beijing (0.04)
- Oceania > Australia > New South Wales > Sydney (0.04)
- North America > United States > New Jersey > Hudson County > Secaucus (0.04)
- North America > United States > District of Columbia > Washington (0.04)
- (2 more...)
Can YOU spot the fake faces? Take the test to see if you can distinguish between real and AI-generated people - as study reveals most of us are overconfident
Trump rushed into Iran crisis meeting as insider warns'strike within hours' 'Deeply concerned' King Charles backs Andrew investigation after royal's arrest and says the'law must take its course' Model agency boss who'scouted' victims for Epstein was secretly planning to testify against him... only to suddenly change his mind before meeting chillingly similar fate to notorious pedophile The monarchy has survived wars and countless crises... but this is why it may not survive Andrew's arrest - and why the rift at the heart of the family is about to get so much worse: ROBERT JOBSON Widower whose wife set herself on fire after alleged affair with married congressman finally breaks silence to reveal their texts... and heartbreaking video of her death Whereabouts of Andrew's ex-wife and daughters remain unknown as former prince is arrested over public misconduct claims Andrew'pushed through' appointment of Jeffery Epstein's fixer to board of Windsor Castle trust despite opposition Virginia Giuffre's family hail Andrew's arrest and say'he was never a prince' But countless women (and some husbands) are secretly getting it for thrilling sex side effects... risking a truly putrid complication FBI'has names and photos of people who may be masked suspect caught on surveillance video outside Nancy Guthrie's home' How DID Beatrice afford her 20s jet-set lifestyle? US assembles the most aerial firepower since Iraq War as Trump prepares to strike Iran'in just DAYS'... and president is'choosing between two devastating options of attack' The side-effects were unbearable and I swore off the drug forever. This is the simple diet that helped me shed the pounds... and I'm not alone. The Prince and Princess of Wales express support for King Charles' statement after Andrew's arrest Jason Bateman says he quit cocaine and alcohol to ease'tension' in his marriage Humiliating real reason Mia Goth left Shia LaBeouf: What'friends and lovers' are all saying behind his back... after Mardi Gras brawl What happens now Andrew Mountbatten-Windsor has been arrested? I went into early menopause in my 30s.
- North America > United States > Virginia (0.24)
- Europe > United Kingdom > Wales (0.24)
- Asia > Middle East > Iraq (0.24)
- (19 more...)
- Media > Television (1.00)
- Media > Music (1.00)
- Media > Film (1.00)
- (5 more...)
- Oceania > Australia > New South Wales > Sydney (0.04)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.04)
- North America > Canada > Ontario > Toronto (0.04)
- North America > Canada > British Columbia > Metro Vancouver Regional District > Vancouver (0.04)